United States Patent and Trademark Office 



UNITED STATES DEPARTMENT OF COMMERCE 
United States Patent and Trademark Office 

Address: COMMISSIONER FOR PATENTS 
P.O. Box 1450 

Alexandria. Virginia 223 1 3-1450 
www.iispto.gov 



APPLICATION NO. 



FILING DATE 



FIRST NAMED INVENTOR 



ATTORNEY DOCKET NO. 



CONFIRMATION NO. 



10/024,982 



12/18/2001 



23910 7590 07/14/2006 

FLIESLER MEYER, LLP 
FOUR EMBARCADERO CENTER 
SUITE 400 

SAN FRANCISCO, CA 94111 



Lester D. Nelson 



FXA0015 



4818 



EXAMINER 



HASHEM, LISA 



ART UNIT 



PAPER NUMBER 



2614 

DATE MAILED: 07/14/2006 



Please find below and/or attached an Office communication concerning this appHcation or proceeding. 



PTO-90C (Rev. 10/03) 



Office Action SummBrv 


Application No. 

10/024.982 


Applicant(s) 

NELSON ETAL. 


Examiner 
Lisa Hashem 


Art Unit 
2614 





- The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1,1 36(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above Is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1 .704(b). 

Status 

I) S Responsive to communication(s) filed on 4-17-06 . 

2a)[EI This action is FINAL. 25)0 This action is non-final. 

3) n Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quay/e, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) ^ Claim(s) 1-41 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) K Claim(s) 1-41 is/are rejected. 
?)□ Claim(s) is/are objected to. 

8) n Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) 0 The specification is objected to by the Examiner. 

10)0 The drawing(s) filed on is/are: a)n accepted or b)n objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

II) D The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12)0 Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 
a)n All b)n Some * c)^ None of: 

1 .□ Certified copies of the priority documents have been received. 

2. n Certified copies of the priority documents have been received in Application No. . 

3. n Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 



Attachment(s) 

1) M Notice of References Cited (PTO-892) 4) □ Interview Sumnfiary (PTO-413) 

2) □ Notice of Draflsperson's Patent Drawing Review (PTO-948) Paper No(s)/Mail Date. . 

3) □ Information Disclosure Statement(s) {PTO-1449 or PTO/SB/08) 5) □ Notice of Infomial Patent Application (PTO-152) 

Paper No(s)/Mail Date . 6) □ Other: . 



U.S. Patent and Trademark Office 
PTOL-326 (Rev. 1-04) 



Office Action Summary 



Part of Paper No./Mall Date 20060707 



Application/Control Number: 1 0/024,982 Page 2 

Art Unit: 2614 

FINAL DETAILED ACTION 

1 . The affidavit filed on 8-2-05 under 37 CFR 1.131 is sufficient to overcome the Cannell 
reference. 

Terminal Disclaimer 

2. The terminal disclaimer filed on 4-17-06 disclaiming the terminal portion of any patent 
granted on this application which would extend beyond the expiration date of U.S. Patent No. 
7,013,279 has been reviewed and is accepted. The terminal disclaimer has been recorded. 

Claim Objections 

3. Claim 35 is objected to because of the following informalities: 

The sequence of letters (a) through (e) is improper based on the Amendment filed on 4- 
17-06 in lines 4-5 of page 9 and line 1 of page 10. Examiner assumes the order should be (a) 
through (d). 

The newly amended limitation ' . . .no in response. . . ' should be ' . . .not in response. . . ' in 
line 2 of page 10 of the Amendment. Appropriate correction is required. 

Claim Rejections - 35 USC § 112 

4. The following is a quotation of the second paragraph of 35 U.S.C. 1 12: 

The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the 
subject matter which the applicant regards as his invention. 

5. Claim 36 recites the limitation "said audio input". There is insufficient antecedent basis 
for this limitation in the claim. 
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Claim Rejections - 35 USC §103 

6. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

7. Claims 1-8 are rejected under 35 U.S.C. 103(a) as being unpatentable over U.S. Patent 
No. 6,366,578 by Johnson in view of U.S. Patent No. 5,764,748 by Rosenthal et al, hereinafter 
Rosenthal. 

Regarding claim 1, Johnson discloses a method for a user or office attendant-type 
program user to communicate over multiple channels (see Fig. 8A: Lines 1-5), comprising the 
steps of: 

(a) communicating over a first channel (wherein the office attendant-type program receives an 
incoming call for a particular user, Mike; Fig. 9B); 

(b) initiating a new communication, which is not responding to an incoming communication 
(an office attendant-type program user sending a Net Message to called party Mike; Fig. lOA; 
col. 28, lines 18-57), by performing the following steps: 

(1) selecting a second channel (sending a Net Message to Mike; Fig. lOA); 

(2) selecting a phrase (col. 28, lines 18-57); 

(3) generating a net message representative of the selected phrase; and 

(4) providing the net message over the selected second channel only while communicating over 
the first channel concurrently (col. 26, lines 27-39; see Fig. lOB; col. 28, line 59 - col. 29, line 
7). 
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Johnson discloses communicating over multiple channels. However, Johnson does not 
disclose generating and providing an audible utterance. 

Rosenthal discloses a method for a user to communicate over multiple channels (see 
Abstract; see Fig. 1), comprising steps of: 

(a) communicating over a first channel (e.g. first call); and 

(b) initiating a new communication, which is not necessarily responding to an incoming 
communication (e.g. responding to an incoming second call signal (e.g. call waiting)) (col. 1, 
lines 16-24; col. 2, lines 6-15 and lines 30-44; col. 5, line 57 - col. 6, line 8; col. 6, line 18 - col. 
8, line 3), by performing the following steps: 

(1) selecting a second channel (e.g. a second call) (e.g. send a speech signal to a second caller); 

(2) selecting a phrase (e.g. Call me later or Call me back in forty five minutes); 

(3) generating an audible utterance representative of the selected phrase; and 

(4) providing the audible utterance over the selected second channel only while communicating 
over the first channel concurrently (col. 8, lines 4-13; col. 8, line 29 -col. 12, line 29). 

It would have been obvious to one of the ordinary skill in the art at the time the invention 
was made to modify the method of Johnson to include generating and providing an audible 
utterance as taught by Rosenthal. One of ordinary skill in the art would have been lead to make 
such a modification to transform a user's silent input selections into equivalent audible signals 
that may be directly transmitted to a recipient on a second communication channel while 
communicating over a first channel concurrently. 
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Regarding claim 2, the method of claim 1, wherein Rosenthal further discloses the step of 
providing the audible utterance over the selected channel (col. 8, lines 4-13; col. 8, line 29 -col. 
12, line 29). 

Rosenthal does not disclose selecting a second channel further includes selecting a 
plurality of channels. 

Johnson further discloses a selecting a second channel further includes selecting a 
plurality of channels, wherein the office attendant-type program user sets up a conference call 
with various users (Figs. 8A-8D; Fig. 1 lA-1 IE; col. 30, line 1 - col. 31, line 26). 

It would have been obvious to one of the ordinary skill in the art at the time the invention 
was made to modify the method of Rosenthal to include selecting a second channel further 
includes selecting a plurality of channels as taught by Johnson. One of ordinary skill in the art 
would have been lead to make such a modification since more than one recipient on a plurality of 
channels can receive a message from the user. 

Regarding claim 3, the method of claim 1, wherein Rosenthal further discloses the step of 
generating an audible utterance includes the step of obtaining an internal representation of a 
phrase element associated with the selected phrase and generating an audible utterance based on 
an internal phrase element (col. 4, lines 54-64; col. 8, lines 4-13; col. 8, line 29 -col. 12, line 29). 

Regarding claim 4, the method of claim 1, wherein Johnson further discloses the step of 
selecting a second channel includes selecting a graphical representation of said second channel 
using a graphical user interface (Fig. 9A and Fig. 9B). 
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Regarding claim 5, the method of claim 1, wherein Johnson further discloses the step of 
selecting a phrase includes selecting a graphical representation of said phrase using a graphical 
user interface (Fig. lOA; col. 28, lines 18-57). 

Regarding claim 6, the method of claim 5, wherein Johnson further discloses the 
graphical representation of said phrase is selected from a group consisting of an icon, a symbol, a 
figure, a graph, a checkbox, a GUI widget, a graphics button, and a pulldown menu button (Fig, 
lOA; col. 28, lines 18-57). 

Regarding claim 7, the method of claim 1, wherein Johnson further discloses said internal 
representation of said selected phrase is obtained from a host computer (wherein the office 
attendant-type program is located on a host computer) (col. 19, lines 26-30; Fig. 8 A and Fig. 
lOA; col. 28, lines 18-57). 

Regarding claim 8, the method of claim 1, wherein Rosenthal further discloses the step 
generating an audible utterance includes text-to-speech processing (col. 4, lines 54-64; col. 8, 
lines 4-13; col. 8, line 29 -col. 12, line 29). 

8. Claims 9-12 and 14-18 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Johnson in view of Rosenthal. 

Regarding claim 9, Johnson discloses a multi-channel telecommunication system (see 
Fig. 8 A: Lines 1-5; Fig. 9A), comprising: 

(a) an audio input or telephone (col. 17, line 48 - col. 18, line 36); 

(b) a channel representation (Fig. 9A and Fig. 9B); 

(c) a phrase representation (Fig. lOA; col. 28, lines 18-57); 
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(d) a display capable of displaying a channel representation and a phrase representation (Fig. 8A; 
Fig. 9A, Fig 1 OA); 

(e) a memory or computer (Fig. 2, 24) capable of storing the channel representation, phrase 
representation, and phrase element associated with the phrase representation, wherein the phrase 
element has an internal representation of a text message (col. 17, line 48 - col. 18, line 36); 

(f) a processor or office attendant-type program, coupled to the audio input, display, and 
memory, wherein the processor initiates a first control signal and a second control signal not in 
response to an incoming communication (e.g. an office attendant-type program user sending a 
Net Message to called party Mike; Fig. lOA; coL 28, lines 18-57); 

(g) a text generator (utilizing Net Messaging), coupled to the processor and memory, wherein the 
text generator generates a text responsive to the first control signal and the phrase element (col. 
22, lines 38-44); and, 

(h) a channel selector, coupled to the processor and text generator, wherein the channel selector 
selects a channel responsive to the second control signal and provides the text message over the 
selected charmel only while communicating over another channel concurrently (col. 26, lines 16- 
26). 

Johnson discloses a multi-channel telecommunication system with channel and phrase 
representation. However, Johnson does not disclose the phrase element has an internal 
representation of an audible utterance and an audio generator. 

Rosenthal discloses a multi-channel telecommunication system (Fig. 1), comprising: 

(a) an audio input or telephone (Fig. 1 : 11,21); 

(b) a channel representation (e.g. alert for an incoming second caller); 
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(c) a phrase representation (e.g. visual display of the calling party name); 

(d) a display capable of displaying a channel representation and a phrase representation (Fig. 1, 
11; col. 2, lines 6-12); 

(e) a memory or switch (Fig. 1, 100) capable of storing the channel representation, phrase 
representation, and phrase element associated with the phrase representation, wherein the phrase 
element has an internal representation of an audible utterance (col. 4, lines 24-64); 

(f) a processor (e.g. button presses), coupled to the audio input, display, and memory, wherein 
the processor initiates a first control signal and a second control signal not necessarily in 
response to an incoming communication (e.g. responding to an incoming second call signal (e.g. 
call waiting)) (col. 1, lines 16-24; col. 2, lines 6-15 and lines 30-44; col. 5, line 57 - col. 6, line 
8; col. 6, line 18 - col. 8, line 3); 

(g) an audio generator (Fig. 1,117), coupled to the processor and memory, wherein the audio 
generator generates an audible utterance responsive to the first control signal and the phrase 
element (col. 4, lines 54-64); and, 

(h) a channel selector, coupled to the processor and audio generator, wherein the channel selector 
selects a channel responsive to the second control signal and provides the text message over the 
selected channel only while communicating over another channel concurrently (col. 3, line 66 - 
col. 4, line 9). 

It would have been obvious to one of the ordinary skill in the art at the time the invention 
was made to modify the system of Johnson to include an audio generator and provide an audible 
utterance over the selected channel as taught by Rosenthal. One of ordinary skill in the art would 
have been lead to make such a modification since an audio generator generates an audible 
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utterance associated with a phrase representation that may be directly transmitted to a recipient 
on a selected communication channel while communicating over another channel concurrently. 

Regarding claim 10, the multi-chaimel telecommunication system of claim 9, wherein 
Rosenthal further discloses said multi-charmel telecommunication system is a telephone (Fig. 1 , 
11). 

Regarding claim 1 1 , the multi-channel telecommunication system of claim 9, wherein 
Rosenthal further discloses the multi-channel telecommunication system further comprises: 
(i) an audio mixer, coupled to the processor and channel selector, mixing audio received from 
said channel selector (col. 10, line 57 - col. 11, line 9). 

Regarding claim 12, the multi-channel telecommunication system of claim 9, wherein 
Johnson further discloses the phrase representation and channel representation are displayed in a 
graphic user interface (GUI) (Fig. 9A and Fig. lOA). 

Regarding claim 14, the muhi-channel telecommunication system of claim 9, wherein 
Johnson further discloses the channel representation is selected from a group consisting of a text 
and a label (Fig, lOA; col. 28, lines 18-57). 

Regarding claim 15, the multi-channel telecommunication system of claim 9, wherein 
Rosenthal further discloses the internal representation is in a format selected from a group 
consisting of a sound file, a record or playback, a text, and a Musical Instrument Digital Interface 
("MIDI") sequence (col. 4, lines 54-64; col. 9, line 24 - col. 11, line 29). 

Regarding claim 16, the multi-charmel telecommunication system of claim 9, wherein 
Johnson further discloses the internal representation is obtained from a host computer (Fig. 2, 50) 
(col. 28, lines 18-57). 
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Regarding claim 17, the multi-charmel telecommunication system of claim 9, wherein 
Johnson further discloses the first control signal is inherently generated in response to a user 
selecting the phrase representation and the second control signal is inherently generated in 
response to a user selecting the channel representation (col. 28, lines 18-57). 

Regarding claim 18, the muhi-channel telecommunication system of claim 9, wherein 
Johnson further discloses the phrase representation and channel representation are selected from 
a group consisting of a button, a switch, a barcode, a label, a glyph, and Braille (Fig. 9A and Fig. 
lOA; col. 28, lines 18-57). 

9. Claim 13 is rejected under 35 U.S.C. 103(a) as being unpatentable over Johnson in view 
of Rosenthal, as applied to claim 9 above, and in further view of U.S. Patent No. 5,894,504 by 
Alfred et al, hereinafter Alfred. 

Regarding claim 13, the multi-channel telecommunication system of claim 9, wherein 
Johnson in view of Rosenthal do not disclose the multi-channel telecommunication system 
further comprises: (h) an audio monitor, coupled to the processor of channel selector, monitoring 
an audio level received from said channel selector. 

Alfred discloses a method for a user or called party to communicate with a plurality 
of recipients over a plurality of charmels (see Abstract; Fig. 3), comprising steps of: (a) 
communicating over a first channel with a first recipient (first caller) (Fig. 3, 301); (b) receiving 
an indication over a second channel of a second recipient (via Call Waiting) (Fig. 3, 305; col. 3, 
line 36 - col. 4, line 9; col. 5, line 50 - col. 6, line 18); (c) selecting to receive advanced 
messaging service by dialing *33 (Fig. 3, 307); (d) the second call-in-waiting caller records a 
message (Fig. 3: 308, 309); and (e) audio input from said first and second channel are mixed and 
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can be heard by the user (col. 7, lines 15-37). Wherein an audio monitor or communications 
switch (Fig. 1, 105), coupled to a processor or message processing system (Fig. 1, 109) and 
channel selector or voice messaging system (Fig. 1,112), monitoring an audio level received 
from said channel selector (col. 4, lines 10-65; col. 7, lines 15-37). 

It would have been obvious to one of ordinary skill in the art at the time the invention 
was made to modify the method of Johnson in view of Rosenthal to include an audio monitor as 
taught by Alfred. One of ordinary skill in the art would have been lead to make such a 
modification since mixed audio input can allow the user to hear the audio input from the 
channels simultaneously and the user can hear both conversations of the channels at different 
audio levels. 

10. Claims 19-22 rejected under 35 U.S.C. 103(a) as being obvious over U.S. Patent No, 
6,941,342 by Nelson in view of Johnson. 

The applied reference has a common assignee and at least one common inventor with the 
instant application. Based upon the earlier effective U.S. filing date of the reference, it 
constitutes prior art only under 35 U.S.C. 102(e). This rejection under 35 U.S.C. 103(a) might 
be overcome by: (1) a showing under 37 CFR 1.132 that any invention disclosed but not claimed 
in the reference was derived from the inventor of this application and is thus not an invention "by 
another"; (2) a showing of a date of invention for the claimed subject matter of the application 
which corresponds to subject matter disclosed but not claimed in the reference, prior to the 
effective U.S. filing date of the reference under 37 CFR 1.131; or (3) an oath or declaration 
under 37 CFR 1 .130 stating that the application and reference are currently owned by the same 
party and that the inventor named in the application is the prior inventor under 35 U.S.C. 104, 
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together with a terminal disclaimer in accordance with 37 CFR 1.32 1(c). This rejection might 
also be overcome by showing that the reference is disqualified under 35 U.S.C. 103(c) as prior 
art in a rejection under 35 U.S.C. 103(a). See MPEP § 706.02(1)(1) and § 706.02(1)(2). 
Regarding claim 19, Nelson discloses a system (see Abstract), comprising: 

(a) a plurality of input channels (col. 6, lines 40-57); 

(b) a processing device for storing an internal representation of a phrase element; and, 

(c) a scanning device, coupled with the processing device, for reading a first code associated 
with the phrase element, wherein the processing device provides an audible utterance only over 
the channel in response to reading the first code while communicating over another channel 
concurrently (e.g. while a user is in a meeting or in a conference call) (Figs. 10-12; col. 13, lines 
20-62). 

Nelson does not disclose reading a second code associated with at least one of the 
plurality of input channels. 

Johnson discloses a system (Figs. 8A-8D), comprising: 

(a) a plurality of input channels (see Fig. 8A: Lines 1-5); 

(b) a processing device (Figs. 8A-8D); a phrase element (col. 28, lines 18-57); and, 

(c) reading a first code associated vnth the phrase element (an office attendant-type program user 
typing a Net Message to called party Mike; Fig. lOA; col. 28, lines 1 8-57) and for reading a 
second code associated with at least one of the plurality of input channels (sending a Net 
Message to Mike; Fig. lOA), wherein processing device initiates to provide a net message only 
over the channel associated with said second code not in response to an incoming 
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communication while communicating over another channel concurrently (col. 26, lines 27-39; 
see Fig. lOB; col. 28, line 59 - col. 29, line 7). 

It would have been obvious to one of ordinary skill in the art at the time the invention 
was made to modify the system of Nelson to include a second code as taught by Johnson. One of 
ordinary skill in the art would have been lead to make such a modification to transform a user's 
silent input selections into equivalent audible signals that may be directly transmitted to a 
recipient on a second communication channel associated with a second code while 
communicating over another channel concurrently. 

Regarding claim 20, the system of claim 19, wherein Johnson further discloses the 
processing device includes: a channel selection device (Figs. 8A-8D), for selecting at least one of 
the plurality of input channels responsive to said second code (Fig. 1 lA-1 IE; col. 30, line 1 - 
col. 31, line 26). 

Regarding claim 21, the system of claim 19, wherein Nelson further discloses the 
scanning device is a barcode scanner (Fig. 11,113). 

Regarding claim 22, the system of claim 19, wherein Nelson further discloses the 
scanning device is a laser scanner (Fig. 10, 104). 

11. Claims 23-26 are rejected under 35 U.S.C. 103(a) as being unpatentable over Johnson in 
view of Rosenthal. 

Regarding claim 23, Johnson discloses a general purpose computing device (Fig. 2, 24), 
comprising: 

(a) a display, capable of displaying a channel representation and a phrase representation (Fig. 
8A, Fig. 9A, Fig. lOA); 



Application/Control Number: 10/024,982 Page 14 

Art Unit: 2614 

(b) a memory or computer (Fig. 2, 24), capable of storing the channel representation, phrase 
representation, and a phrase element associated with the phrase representation, wherein the 
phrase element has an internal representation of a text message (col. 17, line 48 - coL 18, line 

36); 

(c) a processor or office attendant-type program, coupled to the display and memory, wherein the 
processor initiates to generate a first control signal responsive to selection of the channel 
representation and a second control signal responsive to selection of the phrase representation 
(e.g. an office attendant-type program user sending a pre-generated Net Message to a called party 
Mike; Fig. lOA; col. 28, lines 18-57); 

(d) a text generator, coupled to the processor and memory, wherein the text generator generates a 
text responsive to the second control signal and the phrase element (col. 22 , lines 38-44); and 

(e) a channel selector, coupled to the processor and text generator, wherein the channel selector 
activates a channel responsive to the first control signal and provides the text message over the 
selected channel only not in response to an incoming communication while communicating over 
another channel concurrently (col. 26, lines 16-26). 

Johnson discloses a general purpose computing device displaying channel and phrase 
representation. However, Johnson does not disclose the phrase element has an internal 
representation of an audible utterance and an audio generator. 

Rosenthal discloses a device (Fig. 1, 11), comprising: 
(a) a display, capable of displaying a channel representation (e.g. alert for an incoming second 
caller) and a phrase representation (e.g. visual display of the calling party name) (col. 2, lines 6- 
12); 
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(b) a memory or switch (Fig. 1, 100), capable of storing the channel representation, phrase 
representation, and a phrase element associated with the phrase representation, wherein the 
phrase element has an internal representation of an audible utterance (col. 4, lines 24-64); 

(c) a processor (e.g. button presses), coupled to the display and memory, wherein the processor 
initiates to generate a first control signal responsive to selection of the channel representation and 
responsive to selection of the phrase representation (col. 8, lines 4-13; col. 8, line 29 -col. 12, 
line 29); 

(d) an audio generator (Fig. 1, 117), coupled to the processor and memory, wherein the audio 
generator generates an audible utterance responsive to the control signal and the phrase element 
(col. 4, lines 54-64); and 

(e) a channel selector, coupled to the processor and audio generator, wherein the channel selector 
activates a channel responsive to the first control signal and provides the audible utterance over 
the selected channel only while communicating over another channel concurrently (col. 3, line 
66 -col. 4, line 9). 

It would have been obvious to one of the ordinary skill in the art at the time the invention 
was made to modify the general purpose computing device of Johnson to include the phrase 
element has an internal representation of an audible utterance and an audio generator as taught 
by Rosenthal. One of ordinary skill in the art would have been lead to make such a modification 
to transform a user's silent input selections into equivalent audible signals that may be directly 
transmitted to a recipient on a selected communication channel while communicating over 
another channel concurrently. 
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Regarding claim 24, the general purpose computing device of claim 23, wherein Johnson 
further discloses the display is a touchscreen display (Fig. 8A; coL 23, line 43 - col. 24, line 65). 

Regarding claim 25, the general purpose computing device of claim 23, wherein Johnson 
further discloses the channel representation and phrase representation are displayed in a 
Graphical User Interface (GUI) (Fig. 9A and Fig. lOA). 

Regarding claim 26, the general purpose computing device of claim 23, wherein Johnson 
further discloses the general purpose computing device is a personal digital assistant, wherein the 
office attendant-type program may be run remotely (col. 32, lines 8-39). 
12. Claims 27-34 are rejected under 35 U.S.C. 103(a) as being unpatentable over Johnson in 
view of Rosenthal. 

Regarding claim 27, Johnson discloses a telecommunication infrastructure (see Fig. 2 and 
Abstract), comprising: 

(a) a first electronic device coupled to the telecommunication infi*astructure over a first channel 
(Fig. 2,24); 

(b) a second electronic device coupled to the telecommunication infi-astructure over a second 
channel (Fig. 2, 24); 

(c) a third electronic device coupled to the telecommunication infrastructure (Fig. 2, 24; col. 17, 
line 48 - col. 18, line 36), selecting the first channel or the second channel and selecting a phrase 
representation not in response to an incoming communication (an office attendant-type program 
user sending a Net Message to called party Mike; Fig. lOA; col. 28, lines 1 8-57); and 

(d) a processing device (communications system; Fig. 2, 50; col. 7, lines 16-47) coupled to the 
telecommunication infrastructure, capable of storing: 
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1) a phrase element associated with the phrase representation (col. 28, lines 18-57); and, 

2) a software program for providing a Net Message over the selected first or second channel only 
in response to a selected phrase representation while permitting the third electronic device to 
communicate concurrently over the unselected second or first channel (col. 26, lines 27-39; see 
Fig. lOB; col. 28, line 59 - col. 29, line 7). 

Johnson discloses a telecommunication infi-astructure comprising three electronic 
devices. However, Johnson does not disclose providing an audible utterance in response to a 
selected phrase representation. 

Rosenthal discloses a telecommunication infirastructure (see Fig. 1 and Abstract), 
comprising: 

(a) a first electronic device coupled to the telecommunication infrastructure over a first channel . 
(Fig. 1,21); 

(b) a second electronic device coupled to the telecommunication infi^astructure over a second 
channel (Fig. 1,201); 

(c) a third electronic device, coupled to the telecommunication infi-astructure (Fig. 1,11), 
selecting the first channel or the second channel and selecting a phrase representation not 
necessarily in response to an incoming communication (e.g. selecting the second channel in 
response to an incoming second call signal (e.g. call waiting)) (col. 8, line 29 -col. 12, line 29); 
and, 

(d) a processing device (Fig. 1, 100), coupled to the telecommunication infi-astructure, capable of 
storing: 

1) a phrase element associated with the phrase representation; and, 
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2) a software program for providing an audible utterance over the selected first or second 
channel only in response to a selected phrase representation while permitting the third electronic 
device to hold the communication concurrently over the unselected second or first channel (col. 
4, lines 24-64; col. 8, lines 4-13; col. 8, line 29 --ool 12, line 29). 

It would have been obvious to one of the ordinary skill in the art at the time the invention 
was made to modify the telecommunications infrastructure of Johnson to include providing an 
audible utterance in response to a selected phrase representation as taught by Rosenthal. One of 
ordinary skill in the art would have been lead to make such a modification to allow a third 
electronic device to transform a user's silent input selections into equivalent audible signals that 
may be directly transmitted to a recipient on a second communication channel while 
communicating over a first channel concurrently. 

Regarding claim 28, the telecommunication infrastructure of claim 27, wherein Rosenthal 
further discloses the third electronic device generates an in-band signal in response to a phrase 
representation selection and a channel representation selection (col. 8, line 29 -<:ol. 12, line 29). 

Regarding claim 29, wherein Johnson further discloses the third electronic device 
generates an out-of-band signal in response to a phrase representation selection and a channel 
representation selection (Fig. 9A and Fig. lOA). 

Regarding claim 30, the telecommunications infrastructure of claim 28, wherein 
Rosenthal further discloses the signal is a Dual-Tone Multi Frequency ("DTMF") signal (*1) 
(col. 8, line 29 -col. 12, line 29). 
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Regarding claim 31, wherein Johnson further discloses the phrase representation is 
selected from a group consisting of an icon, a symbol, a figure, a graph, a checkbox, a GUI 
widget and a graphics button (Fig. lOA; col. 28, line 59 - col. 29, line 7). 

Regarding claim 32, the telecommunications infrastructure of claim 27, wherein 
Rosenthal further discloses the phrase representation is selected from a group consisting of a text 
and a label (col. 4, lines 54-64; col. 8, line 29 ^ol. 12, line 29). 

Regarding claim 33, wherein Johnson further discloses the processing device is a 
computer coupled to the Internet (Fig. 2, 50; col. 8, lines 27-45). 

Regarding claim 34, the telecommunication infrastructure of claim 27, wherein Rosenthal 
further discloses the processing device is a relay between the first electronic device, the second 
electronic device, and the third electronic device (Fig. 1, 100; col. 4, lines 24-64). 
13. Claims 35-41 are rejected under 35 U.S.C. 103(a) as being unpatentable over Johnson in 
view of Rosenthal. 

Regarding claim 35, Johnson discloses a method for a user to communicate with a 
plurality of recipients over a plurality of channels (see Fig. 8 A: Lines 1-5), comprising steps of: 

(a) communicating over a first channel (wherein the office attendant-type program receives an 
incoming call for a particular user, Mike; Fig. 9B) with a first recipient (e.g. caller); 

(b) selecting a second channel for generating a net message (sending a Net Message to Mike; 
Fig. lOA); 

(c) selecting a phrase representation (col. 28, lines 18-57) and; 
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(d) generating a net message only over said selected channel based on said selected phrase 
representation not in response to an incoming communication while communicating over the first 
channel concurrently (col. 26, lines 27-39; see Fig. lOB; col. 28, line 59 - col. 29, line 7). 

Johnson discloses communicating with a plurality of recipients over a plurality of 
channels. However, Johnson does not disclose generating an audible utterance. 

Rosenthal discloses a method for a user to communicate with a plurality of recipients 
over a plurality of channels (see Abstract), comprising steps of: 

(a) communicating over a first channel with a first recipient (e.g. first call); 

(b) selecting a channel for generating an audible utterance (e.g. send a speech signal to a second 
caller); 

(c) selecting a phrase representation (e.g. Call me later or Call me back in forty five minutes); 
and 

(d) generating an audible utterance only over said selected channel while communicating over 
the first channel concurrently (col. 8, lines 4-13; col. 8, line 29 -col. 12, line 29). 

It would have been obvious to one of the ordinary skill in the art at the time the invention 
was made to modify the method of Johnson to include generating an audible utterance as taught 
by Rosenthal. One of ordinary skill in the art would have been lead to make such a modification 
to transform a user's silent input selections into equivalent audible signals that may be directly 
transmitted to a recipient on a second communication channel while communicating over a first 
channel concurrently. 

Regarding claim 36, the method of claim 35, wherein Rosenthal further discloses audio 
input from said first and second channel are mixed (col. 10, line 57 - col. 11, line 34). 
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Regarding claim 37, the method of claim 35, wherein Rosenthal further discloses 
including the step of: obtaining an internal representation of a phrase element (e.g. text) 
associated with said selected phrase representation (e.g. Call me later or Call me back in forty 
five minutes) (col. 4, lines 54-64). 

Regarding claim 38, the method of claim 35, wherein Rosenthal further discloses said 
step of selecting a channel for generating an audible utterance includes the steps of: accessing a 
channel representation; and, selecting a channel representation (e.g. by dialing the code * 1 to 
select the second caller or calling subscriber to receive an audible utterance) (col 8, line 36 - coL 
9, line 4; col. 9, line 13 - col. 10, line 56). 

Regarding claim 39, the method of claim 38, wherein Johnson further discloses said 
channel representation is displayed on a graphical user interface (Fig. 9A). 

Regarding claim 40, the method of claim 35, wherein Rosenthal further discloses 
said step of selecting a phrase for generating an audible utterance includes the steps of: accessing 
a phrase representation; and, selecting a phrase representation (col. 4, lines 54-64; col. 8, line 36 
- col 9, line 4; col. 9, line 13 - col. 10, line 56). 

Regarding claim 41, wherein Johnson further discloses said phrase representation is 
displayed on a graphical user interface (Fig. lOA; col. 28, line 59 - col. 29, line 7). 

Response to Arguments 
14. In regards to Applicant's remarks in the Amendment filed on 4-17-06 that Johnson does 
not teach ' . . .any user of the invention can initiate a second communication not in response to an 
incoming call. . . ' . Examiner disagrees. Johnson clearly discloses communicating with an 
incoming caller on a first channel and initiating a new communication by a office attendant-type 
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program user on a second channel which is not responding to an incoming communication (e.g. 
an incoming call on the second channel). Johnson allows the office attendant-type program user 
to initiate communication to a second party (e.g. Mike) while communicating to a first party (e.g. 
an incoming caller), even when there is no incoming call received on the second channel (col. 
26, lines 27-39; see Figs. 8 A, 9B, lOB; col. 28, line 59 - col. 29, line 7). 

15. Applicant's arguments with respect to claims 1-41 have been considered but are moot in 
view of the new ground(s) of rejection. Please see all rejections above. 

Conclusion 

16. Applicant's amendment necessitated the new ground(s) of rejection presented in this 
Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 
Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed vdthin TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1 .136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 

17. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure: 
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• U.S. Patent No. 5,991 ,723 by Duffin discloses an operator communicating over multiple 
channels comprising generating and providing an audible utterance over a selected 
second channel only while communicating over a first channel concurrently 

1 8. Any response to this action should be mailed to: 

Commissioner for Patents 
P.O. Box 1450 
Alexandria, VA 22313-1450 

Or faxed to: 

(571) 273-8300 (for formal communications intended for entry) 

Or call: 

(571) 272-2600 (for customer service assistance) 

19. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Lisa Hashem whose telephone number is (571) 272-7542. The 
examiner can normally be reached on M-F 8:30-5:30. 

If attempts to reach the examiner by telephone are imsuccessful, the examiner's 
supervisor, Fan Tsang can be reached on (571) 272-7547. Any inquiry of a general nature or 
relating to the status of this application or proceeding should be directed to the Group 
receptionist whose telephone number is (571) 272-2600. 

20. Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
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system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 
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